Direct Optimization of Margins Improves Generalization in Combined Classifiers

نویسندگان

  • Llew Mason
  • Peter L. Bartlett
  • Jonathan Baxter
چکیده

Cumulative training margin distributions for AdaBoost versus our "Direct Optimization Of Margins" (DOOM) algorithm. The dark curve is AdaBoost, the light curve is DOOM. DOOM sacrifices significant training error for improved test error (horizontal marks on margin= 0 line)_ -1 -0.8 -0.6 -0.4 -0.2 0 0.2 0.4 0.6 0.8 1 Margin

منابع مشابه

Direct Optimization of Margins Improves

0 20 40 60 80 100 Sonar Cumulative training margin distributions for AdaBoost versus our \Direct Optimization Of Margins" (DOOM) algorithm. The dark curve i s A d a B o o s t , t h e light curve is DOOM. DOOM sacriices signiicant training error for improved test error (horizontal marks on margin= 0 line).

متن کامل

A HYBRID SUPPORT VECTOR REGRESSION WITH ANT COLONY OPTIMIZATION ALGORITHM IN ESTIMATION OF SAFETY FACTOR FOR CIRCULAR FAILURE SLOPE

Slope stability is one of the most complex and essential issues for civil and geotechnical engineers, mainly due to life and high economical losses resulting from these failures. In this paper, a new approach is presented for estimating the Safety Factor (SF) for circular failure slope using hybrid support vector regression (SVR) and Ant Colony Optimization (ACO). The ACO is combined with the S...

متن کامل

PREDICTION OF EARTHQUAKE INDUCED DISPLACEMENTS OF SLOPES USING HYBRID SUPPORT VECTOR REGRESSION WITH PARTICLE SWARM OPTIMIZATION

Displacements induced by earthquake can be very large and result in severe damage to earth and earth supported structures including embankment dams, road embankments, excavations and retaining walls. It is important, therefore, to be able to predict such displacements. In this paper, a new approach to prediction of earthquake induced displacements of slopes (EIDS) using hybrid support vector re...

متن کامل

Improving ECG Classification Accuracy Using an Ensemble of Neural Network Modules

This paper illustrates the use of a combined neural network model based on Stacked Generalization method for classification of electrocardiogram (ECG) beats. In conventional Stacked Generalization method, the combiner learns to map the base classifiers' outputs to the target data. We claim adding the input pattern to the base classifiers' outputs helps the combiner to obtain knowledge about the...

متن کامل

Chance constrained uncertain classification via robust optimization

This paper studies the problem of constructing robust classifiers when the training is plagued with uncertainty. The problem is posed as a Chance-Constrained Program (CCP) which ensures that the uncertain datapoints are classified correctly with high probability. Unfortunately such a CCP turns out to be intractable. The key novelty is in employing Bernstein bounding schemes to relax the CCP as ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

متن کامل
عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1998